Artificial Intelligence Project~4»RLE and MIT Computation Center 

Memo 10 
THE LISP DIFFERENTIATION DEMONSTRATION PROGRAM 

by K. Kaling 

1. Introduction 

This program is a byproduct of the machine language which 
is being developed for the Artificial Intelligence project. It 
was written because the process of differentiation and to some 
extent that of simplification^ turned out to be very conveni- 
ently expressable in LISP. There are two main reasons for 
this: one is the fact that algebraic expressions are most 
easily represented In a computer by means of a list language 
and the other is the ability of LISP to describe recursive 
processes <, 

The program is internally in I two distinct parts . The 
first is the differentiation program, which is written out 
for the case of PLUS and TIMES (The only differentiable 
functions that do not have a fixed number of arguments) and 
which handles all other functions by making substitutions of 
their arguments into the gradient. It is up to the user to 
add the. gradients of functions which he wishes to differenti- 
ate. It will normally take one card per function and there 
is no restriction on the number of functions or their order. 

When the differentiation program was first tested out 
it was found that the resulting expressions were usually 
enormous and contained a large number of redundant symbols * 
The second part therefore consists of a simplification program, 
which is written out for PLUS andJTIISES, the chief offenders, 
and for all other functions* the recognition of degenerate 
cases is built it. Again it is up to the user to add the 
degenerate cases and their equivalents for the functions in 
which he 13 interested., and again! there are no restrictions 
on their number or order. 

There is one further feature ! which involves the Universal 
LISP Function "Apply". Apply is in effect an interpreter which 
causes any process defined in LISP to be performed on an 
expression,. The user may have his own list processes carried 
out in two places, (a) during the; simplify program, whenever 
any function appears which he has j introduced (any one LISP 
program will be for one function only, but each function may 
have such a program)., (b) .after the above nit.rpllf i''a'".".~n 



.0~\.rccd l:o ^rry carry cut any further manipulations 
: /'l:rj o::};-vo3fjion* The demonstration program is 
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;•.:'•...; vr.;'.c: expressions and LIS? expressions are written in 
a izr.tir.cr 7-:, external notation. For instance* vie write 
::;"-:■:;■. in-; y} no ( TB135 . :: s (?LUS*x*l)* (SIK,y) ) 
nni c corner (::)*(}} as (cons. (car*x}*INTV*0) ) 
Ths cul- ;:-.•.-■ is in n similar form* An infix reader and printer are 
being considered and may be added at a later date. At the moment 
only literals and dibits are legal characters and the name3 of 
functions lilce RATIO and MINUS must be written as words. numbers 
are treated exactly lilce symbols and "simplify" dees no arithmetic 
with tier., nor doss it enumerate* The user Is cautioned against 
a cemmea scarce of error* namely the failure to provide a suf- 
ficient number of right parentheses. 



.ie foilovning sections familiarity with the basic LIS? 
functions and the method of writing program functions is assumed. 

Let L be the list representation of an algebraic expression ; 

Let V be the variable • with respect to which it is being dif- 
ferentiated * Then 
3iff{L i ,V)^/L«V— ?1^ atom(L)-^Q* car(L) - PLUS-=>cons(PLUS,niaplls 

■{cdr;L3^{0"#Siff{car(j),V)))),car(L)"TTHES-*eons{3PLUS,iaaplis 

(cdr{L5 3 7v(J,cons(TIHES,maplis(cdr(L),A(K,J^C— ^car-CK),! > 

dlff{oar{lO*V))))})) f T-^cons(PLUS^map2(sublis{pair{car(gradnt 

(car(I,}}) 5 cdr{L)5 s cadr{gradnt(car(L)5))*cdr{L)^(J,K ? 

Ii3t(Ti:id:s 5 copy{car{J)}*diff(car{K),V)))})/ 

t(L}- s3arch(I-hA(j,car{j}«sradl) ? A{j,cadr(j)}*print comment) 
5,2 The case of functions other than PLUS and TIMES is not 
;ooily understood from reading this definition, and an example is 
Therefore given . d{u/V)/dx 

d(u/V)dx « l/Vo(dx/dx) * (-«A 2 ) .(dv/dx) 
L-e gradient of (R*TIO*u*v) is therefore (l/v,(-u/V )) 
The following expression is added to the property list of RATIO. 

(GRAD1* { (u, v) s { (RATIQ,l,v) , (RATIO* (MINUS,0,u) , (TIMES,v,v) ) ) ) ) 
Suppose that (RATIO* l,x) is being differentiated o 
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->( (u,v), ( ( RATIO,!, v), (RATIO.. 



^...■..s-c , ^• J , ; ; -v gractn t\ RATIO j- 

:;:;v:.-;j:S.o.y.}.«- (times, v,v)))) « c 

Then pGir(car{G), cdr(L) )—>( (u,l),{v,x)) - Ii 

and cac!r(e,r> £ dnt(eai>(L})}— *( ( RATIO, 1, v), (RATIO. (MINUS, 0,u), 

(TIMSS,v,v)))"I 
hence sublis (H, 1)— i K (RATIO,l.,x) , (RATIO, (MINUS, 0,1. ( TIMES, x,x) ) ) **M 
so 'cfcav- r,:ap2(M,cdr{L), A(J,K, list(TIMES 3 e.opy(car( j)),dlff (car 

(K) A'O ) ) M»{ (TIMES. { RATIO,!, x) ,0) , (TIMES, (RATIO, (MINUS, 0,1 ) 
{TTKES,x,x)),l)) 
and when preceded by a PLUS this is the required result, though 
in some need of simplification, 

3=3 It will be noted that MINUS is treated as a binary operator, 
an arbitrary decision that was \ prompted by a wish to treat PLUS 
and MINUS as similarly as possible to TIMES and RATIO-. - .' 
Since d{u-v)/dx « du/dx - dv/dx 

One writes the gradient of MINUS as (l f ( MINUS, 0,1}} 
so that on the property list of MINUS should appear 

(GRADl,((\i,v), (1,(MINUS,0,1))))' 
However if a unary minus were used., one would put on the property 
list 

(GRADl,{(u),((MINUS,l))5) : 

V* . Simplification 

^•J Sums and products are simplified in the following ways. 

1. Products that contain a zero term are replaced by zero. 

2. Zero terras in sums or unit terms in products are deleted. 
3<, Sums of svms are combined to contain only one PLUS and 
products of products are combined to contain only one TIMES. 
^. A sum of no terms is zero, a product of no terms is one. 
5. A sum or products of only one term is the term itself. 
Let L be a well-formed algebraic expression in LISP. 
Simplify (L) «/atom(L}-9return(L), 

K«maplis(cda?(L),A(J,siimpllfy(car(J)))) 

car{L)^PLUS-*go(al) j v ■ 

Kl^mapccn ( K, 1% ( J, car ( j)**0— f A s caar ( J)**PLUS— >cdar ( J) ,T~»cons 

(car(j),/\))) ! 

null ( Kl ^return ( ) 
null(cdr(Kl) )— >re turn (car (Kl) ) 
T— >re tur n( cons ( PLUS, Kl)) ! 

car { L )/TIMES— >go ( a2 ) 



T— >soai*ch{K ? a( J J cai , { j)«-0) ,refcupn( 0) ,go(a3) ) 

(a3) iu«mapcon(K,A{ J,car( j)~l— */\,caar( j)**TIMES-3Cdar( J) ,T — * 

eons(car(j) ? /\)))- 
' rauI(KI)--->return{l) 

null(cdr(ia)}^refcurn(car( : :Kl)) 
l^?raturn(cons{TEIES*;Kl)) 
(a2) ri-'3earch{car(L),?i{c('pC.ar(j)«SPSCl) 9 A(j,cadr(j)5 s go{aiJ-)) 

retuini(3earch{il,7i(j J inst{oaa^^^caar{Jj,K),A(j 5 siJblis(inst{cadar 

{j},caar(j),K},eaddrCJ)),L)) ■' 

(a4) reUim{search(car(L)^(J 5 ca3:»{j)^S?EC2 9 ?^(J,apply(oadadr 

(j),L,caadr(j))),L) 
^.2 Examples . will again be given to clarify the method whereby 
degenerate cases are recognized, and whereby the user can introduce 
his own program. 

Suppose. (RATI0,x,x) is to he replaced by "1" and (RATI0,x,l) 
by "x n « • . . 

Many other cases such as 0/y, x/0, x/(y/z), could of course be , 
added. ' ■ 

We add to the property list of RATIO 
(SPECl^(((u,u),((u) a (v)),l.),((wi,v),((u),(v,ll),tt))) 

M of (a2) above will be cadr of this expression, 
Where L is (RATI0,xjx) . j • 

1,nstC{{u} a (v)') s (n*u) 5 (x,x)>— ^({u>x)") '' ■ • 

and sublis ({(u,x-))»l)— »1. 
Where. L is (RATI0,x,l) : 

inst{ ( (x) , { v,l ) } , (u,v) , (u,v), (x,l) )--${ (u,x) , (v,l) ) 
and sublis (C{u,x},(v,i)),u)--*x 

An example with "Apply" will be provided later. 

5 c l^lSHl Statements 

The imperatives which the program can obey are 
(DIFFERENTIATE, (SIN, X),X) 

which means, differentiate sln(x) with respect to x, 
(SIMPLIPYy{?LUS,Y,0)) : . " 

The meaning is obvious. ■ 
STOP . causes the computer to halt. 

To add gradients, degenerate cases or LISP program to the 
property list of a function, one must write 
(FUNCTION, SIN) (GRAD1, ( (U),((C0S,V)))) or 
(FUNCTION,LCG) (SPEC1,( ( (U), ( (U,1)),0) ) 
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It is very important to spoil the following words correctly^ 
DIFFERENTIATE^, SIMPLIFY, FUNCTION, PLUS,, TIMES, STOP, GRAD1, 
'SPEC1, SPEC2. 

It is also essential to have the correct depth of paren- 
theses, and to include matching right hand parentheses. 

^ ° Pr.°^:^ a IE J?£iSJi"" SB±. 

The demonstration will always begin with 

"THIS IS A DEMONSTRATION OF SYS1B0LIC DIFFERENTIATION USING 

LIS? 5 A LIST PROCESSING LANGUAGE. THE CARD CONTAINING THE 

EXPRESSION TO BE DIFFERENTIATED, AND THE GRADIENTS OF ALL 

THE FUNCTIONS USED IN IT, SHOULD FOLLOW THE DECK WHICH HAS 

JUST BEEN READ IN. 

KOI'J PRESS THE START KEY. 

A card reading (DIFFERENTIATE, (E),x) causes the print-out 

(S) 

IS NOW BEING DIFFERENTIATED WITH RESPECT TO 

X . ' 

The result is presented by 
THE DERIVATIVE IS 
E 7 : 

A card reading (SIMPLIFY,^)) causes the print out 

C s i) 

CAN BE SIMPLIFIED TO ' 

( E 2) 
A card reading (FUNCTIONS) (GRAD1, (E)) causes the print out 
G 

HAS RON ON ITS PROPERTY LIST \ 
■(GRAD1,(E)) 

If the program is called upon to differentiate a function 
without having previously been provided with the gradient, then 
the program will print out: 
THE PROGRAM HAS NOT BEEN GIVEN THE GRADIENT OF 
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PUT A CARD ON WHICH ITS GRADIENT IS PUNCHED IN THE CARD READER 

AND PRESS THE START KEY* 

If the program is given an expression which is not of the types 

described in section 5, it will print. 

E 

IS HOT AN ACCEPTABLE EXPRESSION. TRY AGAIN. 

If the program attempts to read when there are no more cards in 
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the card reader, either* because the user ha3 pressed the start 
key afte.v a machine halt or because the program ha3 Just read 
an expression of the form (FUNCTIONS) then the program will 

print. | 

THERE IS NO CARD FOR THE READER TO READ. TRY AGAIN. 
7c' Check!;*;; Out Exnressions '< 

It was mentioned in Section 1 that the user can add any 
LISP program of his own, which will foe executed after the 
simplify program described in Section k has been executed, 
and will use as its argument the result of such previous 
simplification. The intention of this facility is to make 
possible cancellation, counting, small Integer arithmetic and 
infix printing, for example. 

The user is referred to the LISP programmer's Manual for 
information on checking out programs for Apply. This LISP 
program can then be added to the demonstration program by 
writing 

( FUNCTION, SIMPLIFY) ( SPEC2, ( ( A) , (F) ) ) 

Both SIMPLIFY and DIFFERENTIATE (unslraplif led) are available to 
Apply as subroutines. The purpose of the imperative 
(SIMPLIFY^) 

is of course to make easy the checking out SPEC1 and SPEC2 
type additions to the property list of functions. Note. that 
nothing added to the property lists of PLUS and TIMES will 
affect the program in any way.; 

The authors of this program accept no responsibility for 
any results produced by it, right or wrong, and do not wish to 
answer any questions about it<, 



